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Image compression algorithms based on the wavelet transform are an increasingly 
attractive and flexible alternative to other algorithms based on block orthogonal 
transforms. While the design of orthogonal wavelet filters has been studied in 
significant depth, the design of nonorthogonal wavelet filters, such as linear-phase 
(LP) filters, has not yet reached that point. Of particular interest are wavelet 
transforms with low complexity at the encoder. In this article, we present known 
and new parametrizations of two families of LP perfect reconstruction (PR) filters. 
The first family is that of all PR LP filters with finite impulse response (FIR), 
with equal complexity at the encoder and decoder. The second family is one of 
LP PR filters, which are FIR at the encoder and infinite impulse response (HR) 
at the decoder, i.e., with controllable encoder complexity. These parametrizations 
are used to optimize the subband/wavelet transform coding gain, as defined for 
nonorthogonal wavelet transforms. Optimal LP wavelet filters are given for low 
levels of encoder complexity, as well as their corresponding integer approximations, 
to allow for applications limited to using integer arithmetic. These optimal LP filters 
yield larger coding gains than orthogonal filters with an equivalent complexity. The 
parametrizations described in this article can be used for the optimization of any 
other appropriate objective function. 


I. Introduction 

Tree-structured subband coding is an increasingly attractive and flexible alternative to other subband 
coding techniques based on block orthogonal transforms, which exhibit annoying blocky artifacts at low 
bit rates. The main building block of tree-structured subband coders is the two-channel subband coder. 
Given a number of levels of decomposition, L, the corresponding subband transform is a function of the 
analysis lowpass and highpass filters, H 0 (z) and H\{z), and the synthesis lowpass and highpass filters, 
Gq(z) and Gi(z ) (see Fig. 1). Most filter banks of interest to subband coding are known as perfect recon- 
struction (PR) filter banks, and most filter banks with near-perfect reconstruction are approximations or 
truncations of PR filter banks. 

Of particular interest to onboard image compression is the issue of computational complexity of the 
subband/wavelet transform; onboard resources are often limited, and so time and space complexity con- 
straints are common. Also of particular interest are good subband transforms that are less complex 
than their inverse transforms, i.e., impose less complexity at the encoder, at the cost of more at the 
decoder. Since this feature cannot be obtained with the use of orthogonal transforms (which always have 
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equal complexity at the encoder and at the decoder), most of our design efforts will be turned toward 
nonorthogonal filter banks, more precisely linear-phase (LP) filter banks. 



X(Z) 


Fig. 1. Analysis and synthesis sections for a maximally decimated two-band filter bank. 

In this article, we report on tree-structured subband coder (or wavelet filter) designs that satisfy 
complexity constraints at the encoder. First, we review the theory of PR filter banks and describe two 
families of solutions that are appropriate for our purposes. Then, we review definitions and known upper 
bounds on the subband coding gain of arbitrary linear transforms (not necessarily orthogonal). Finally, 
we derive solutions that maximize the subband coding gain, an incomplete, but informative measure 
of the performance of a subband transform-based coder, and give good integer approximations of these 
solutions. We conclude with the design of optimal boundary filters. 


II. Two-Channel PR Filter Banks: A Review 

Consider the two-channel filter bank presented in Fig. 1 (see [1] as a general reference). 

To derive the equations satisfied by such a filter bank, an expression is needed for the ^-transform 
of the reconstructed signal, X(z ), in terms of the original signal, X(z), and the analysis and synthesis 
filters, H k (z) and G k (z), respectively. The expressions for the X k (z) are given by 


X k {z) = H k (z)X(z), k = 0,1 
After decimation, the ^-transforms are given by 

V k (z) = i [x k (z 1 / 2 ) + X k (-z 1 ' 2 )] , k = 0, 1 
The ^-transform of the signals y k (n) are given by 

Y k (z) = V k (z 2 ), k = 0,1 


( 1 ) 


( 2 ) 


= -[. X k (z)+X k (-z )] 


(3) 


^[H k (z)X(z) + H k (-z)X(-z)] 


Finally, the reconstructed signal becomes 
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( 4 ) 


X(*) = \lGo (z)G 1 (z)] 


H 0 {z) 

Hi{z) 


H 0 (-z) 


I - X(z) 
X{-z) 


*M =\{Mz)Go{z) + H l {z)G l {z)){X{z)) 


+ 2 (Ho(-z)G 0 (z) 4- Hi(-z)G 1 (z)) ( X(-z )) 
For a PR filter bank, we must have, by definition, 


( 5 ) 


X(z)=z~ l (X(z)) 


i.e., the reconstructed signal X(z) is a delayed copy of input signal X(z), which yields the following two 
PR conditions: 


H 0 (z)G 0 (z) + #i(s)Gi(z) = 2 z~ l 

Ho(-z)G 0 (z) + H^-z^iz) = 0 


( 6 ) 


These equations can be rewritten as a linear system of two equations where G 0 (z) and Gi(z) are the 
variables and Hq(z) and Hi(z) are assumed to be known: 


' H b (i) 

Hi(z) ' 

'Go(z)' 


2 z~ r 

H 0 (-z) 


Gi(z)_ 


0 


Define the transfer function Q(z) as 


( 7 ) 


Q( z ) = H 0 (z)Hi(-z) 


and define A {z) as 


A(z) = Q(z) - Q(- Z ) 

Note that A(-z) = -A (z). A well-known condition for a unique solution to exist is that the determinant 
of the matrix on the left side of Eq. (7) be nonzero. This yields the following condition on Q{z ): 


A (z) = Q(z) - Q(-z) ? 0 

which yields the following solution for Gq(z) and Gi(z): 


G 0 (z) 


2 z~ l 


Hi(-z) 

AM 


Gi(z) 


= -2 z~ l 


Ho(-z) 

AM 


( 8 ) 
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For finite impulse response (FIR) solutions to Eq. (8), one must require that A (z) be a simple delay 
(A( 2 r) = 2 x z~ l ), and so the equations now become 


G 0 (z) rH^-z) 
Gi(z) = -H 0 (-z) 


( 9 ) 


If A(z) is not a simple delay, then the PR synthesis filters Gq(z) and Gi(z ) are infinite impulse response 
(HR), irrespective of the choice of H 0 (z) and H\{z), i.e., whether the analysis filters are FIR or not. 

The main two properties sought in PR filter banks for image compression are orthogonality and phase 
linearity. The only FIR wavelet filter that satisfies both properties simultaneously is the Haar filter. The 
HR “sine” wavelet [see Eq. (13)] also satisfies both properties simultaneously. 

We now describe two families of LP PR filter banks among which we will look for those filters with 
the largest coding gain under some complexity constraints. 


III. Linear-Phase PR Filter Banks 

There are only two different types of LP (symmetric) filters (whether they are FIR or HR), depending 
on whether there are one or two “center” coefficients. Symmetric filters with one center coefficient (odd- 
length for FIR filters) are called whole-sample symmetric (WSS), while those with two center coefficients 
(even-length for FIR filters) are called half-sample symmetric (HSS). 

Since we are interested in solutions with low complexity at the encoder, we will consider the following 
solutions to the PR equations: 


(1) Both the analysis and synthesis filters are FIR 

(2) The analysis filters are FIR, while the synthesis filters are HR (in practice, optimized 
truncations of HR solutions are used) 

A. FIR/FIR Solutions 

Given that Eq. (9) is satisfied, the PR equations [see Eq. (6)] become 


A(z) = Q(z) - Q(—z) = H 0 (z)H 1 (-z ) - H 0 (~z)H 1 (z) = 2 z~ l (10) 

where the sum of the lengths of Hg{z) and H\(z) (|/io| + l^il) can be shown to always be a multiple of 4 
(see [7]), and l — (|/i 0 | T |/ii|)/2 — 1. Given a choice for Ho(z), there are an infinite number of solutions 
for Hi(z) satisfying Eq. (10). The parametrization of this infinite family varies with the nature of the 
symmetry of the prototype filter H 0 (z ): either HSS or WSS filters. 

1. WSS Solutions. The following theorem (as well as its proof) is from [7]; it parametrizes all filters 
H[(z) that are complementary to a prototype filter H 0 (z). 

Theorem 1: If the lengths |h 0 | and |/i! j of the two complementary filters H 0 (z ) and H x {z) are odd 
and satisfy 


Ifcol — |^i| + 2 • 
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and if II <> ( — 1) = 0, then all the highpass analysis filters H[(z) complementary to H a (z) are of the form 

H[(z) = z~ 2m Hi(z) + E(z 2 )H 0 (z) 

where 


E(z 2 ) = + z- 2 ^-^) 

i= 1 ' 

The length of H[(z) is clearly \hi\ = \hi\ + 4m. It is sometimes appropriate to impose zeros at 7 r 
for lowpass filters ( H 0 (e ~ j7V ) =*H 0 (-1) = 0) or zeros at dc frequency for highpass filters (. Hi(e J7r ) = 
^i(l) = 0). Since E(l) = 2 is nonzero in general, fT 0 (-l) = 0 is the only way to ensure that 

^i( — 1) = = V2- Finally, the requirement that # 1 ( 1 ) = 0 (which we will find important later) 

translates into a constraint on the coefficients c^: 


H[{ 1 ) = Hi(l) + E(l)H 0 (i) = H 1 (l) + 2H 0 (l)J2^i 

i = 1 


Therefore, to ensure that H[{z) has a zero at dc frequency, we must have 


= 


Hi(l) 

2H 0 (1) 


( 11 ) 


If # 1 ( 1 ) — 0, then we must have YmLi a i — 0* 

FIR filter banks will be referred to as |/i 0 |/|hi| (remember that |^ 0 | = |hi| and J^l = \ho\). In 
Table 1, we give an example of the construction of a 5/7 PR filter pair from a 5/3 PR filter pair (h 0 = 
[ 1? 3, 4, 3, —1] and hi [— 1, 3, —1]) using Theorem 1. The solution with a zero at dc frequency is 

found using Eq. (11) and yields 

-1 


and 

h! = 111 ~ 3 > ~ 19 ’ 42 > -I 9 ’ ~ 3 > 1] 

1 16 


Table 1. Generating a 5/7 filter from a 5/3 filter. 


Filter 

1 

z- 1 

z~ 2 

z~ 3 

z~ 4 

z~ 5 

z~ 6 

z~ 2 Hi{z) 



-.1 

3 

-1 



H q {z) 

-1 

3 

4 

3 

-1 



z~ 2 H 0 (z ) 



-1 

3 

4 

3 

-1 

(l + z~ 2 )H 0 (z) 

-1 

3 

3 

6 

3 

3 

-1 

H'i(z) 

-ai 

3qi 

— 1 4- 3ax 

3 + 6ai 

— 1 + 3ai 

3cm 

-on 
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2. HSS Solutions. While the following theorem (the equivalent to Theorem 1, but for HSS solutions) 
is not given in [7], it can be obtained in the same way as for WSS filters. We now give it without proof. 

Theorem 2: If the lengths |/io| and |/ii| of the two complementary filters Hq{z) and H\(z) are even 
and equal, then all the synthesis filters H'Az) complementary to Hq{z) are of the form 


H[{z)^z- 2 m H l {z)-^E{z 2 )Ho{z) 


where 


E(z 2 ) = J2 a i (V 2(i-1) - z~ 2 ( 2m - i+ D) 


Note that for HSS filters, there is always a zero at n for lowpass filters and at zero frequency for highpass 
filters, and so the construction implied by Theorem 2 always yields H'( 1) — Hi(-l) =0. 

In Table 2, we give an example of the construction of a 2/6 PR filter pair from a 2/2 PR filter pair 
{h 0 = [1, 1] and h x = [1, -1]) using Theorem 2. If we choose = 1/8, we obtain a filter which has the 
largest possible number of zeros at dc frequency for a 2/6 PR filter: h[ = [1, 1, —8, 8, —1, —1], 

Table 2. Generating a 2/6 filter from a 2/2 filter. 


Filter 

1 

z - 1 

z~ 2 

z- 3 

2- 4 

z- 5 

Hi (z) 



1 

-1 



H 0 (z) 

1 

1 





z~ 4 H 0 (z ) 





1 

1 

ai(l - z~ 4 )Hq{z) 

ai 

ai 



-<*i 

-ai 

H[(z) 

Oil 

Oil 

1 

-1 

-Oil 

—Oil 


B. FIR/IIR Solutions 

Another interesting set of solutions to the PR equations involves IIR filters. We have seen previously 
that if Hq{z) is given, there exist an infinite number of highpass filters H\{z) which are complementary 
to it. However, if Hi{z) is chosen conveniently to satisfy 


I#! (e JW ) | = \Hq (e~i w ) j (12) 


then the solution for the synthesis filters is unique and is defined by Eq. (8). Again, HSS and WSS filters 
must be treated separately. 


1. WSS Solutions. For WSS filters, a good choice, from a coding perspective, for HAz) that satisfies 
Eq. (12) is 


H\{z) = -z 1 Hq(—z) 


This yields 
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Q(z) = z 1 H 0 (z) 2 

and 


A(z) = z-\H a (z) 2 + Ho(-zf) 

Replacing in Eq. (8), we obtain the following HR solutions for the synthesis filters: 


G 0 (z) = 2z 


-l 


z~ l H 0 {z ) 


H 0 (z) 2 + H 0 (-z) 2 


and 


Gi(z) = (-l) l z(G 0 (-z)) 

We now consider two examples that will prove useful later. 
Example 1: If we choose Hq(z) — (1 + z~ 1 ) 2 , then 

Q{z) = z-\l + z~ 1 ) 4 

and 


A(^) = 2z~ 1 (l 4- 6z~ 2 + z~ 4 ) 


This yields the HR solution for Gq(z): 


G 0 (z) 


(1 + z~ 1 ) 2 
1 + 6 z~ 2 + z~ 4 


Note that the product filter defined as P(z) = H 0 (z)G 0 (z) in this last example is the Butterworth filter 
of order two (see [8] for further insights on this remark), i.e., 


P(z) = H 0 (z)G 0 (z) = 


(1 + z~ 1 ) 4 
1 + 6z~ 2 + z~ 4 


Example 2: If we choose 


then A(z) becomes 


H 0 (z ) = -1 + 7z~ 2 + 12z~ 3 + 7z~ 4 - z ~ 6 


A(^) = 2Z- 1 (1 - 14z~ 2 + 35z~ 4 + 244z~ 6 + 35z~ 8 - 14 z~ 10 + z~ 12 ) 
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The product filter Q(z ) becomes 


Q(z) = 


(-1 + 7z~ 2 + 1 2z~ 3 + 7z~ 4 - z ~ 6 ) (1 + z- 1 ) 2 
1 - 14z~ 2 + 35 z~ 4 + 244^- 6 + 35z~ 8 - 14z~ 10 + z~ 12 


2. HSS Solutions. For HSS filters, the choice we make is 

Hi(z) = H 0 (-z ) 


which yields 


Q(z) = H 0 (zf 

and 


A(z) = H 0 (z ) 2 - H 0 (-zy 


The HR solution Gq(z ) is, therefore, 


— ( I'd+i ^ z H 0 ( z ) 

GoW - ( - X) H 0 (z) 2 -H B (-z ) 2 


with 


Gi ( z ) = (— l ) i+1 (? 1 ( Z ) 

We now consider an FIR inversion example that will prove useful later. 
Example 3: If we choose 

Hq { z ) = -1 + 2z~ 1 + 9z~ 2 + 9z~ 3 + 2z~ 4 - z~ 5 

then A ( z ) becomes 

A ( z ) = z- 1 (-8 + 362" 2 + 344z~ 4 + 36z~ 6 - 8 ^“ 8 ) 

and we obtain the following HR solution for the synthesis lowpass filter: 

n / v _ -1 + 22:“ 1 + 9z~ 2 + 9 z~ 3 + 2 z~ 4 - z~ 5 
0{Z) ~ -8 + 36^- 2 + 344z“ 4 + 36^- 6 - 8^- 8 
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IV. The Subband Coding Gain for PR Filter Banks 

There exists a measure of the coding performance of transform-based coding schemes known as the 
transform coding gain [4]. The coding gain is simply defined as the ratio of the reconstruction error 
variance of the transform coding scheme and the reconstruction error variance of a pulse code modulation 
(PCM) scheme (i.e., without a linear transformation to decorrelate the signal). If the coding gain is 
expressed in decibels (dB), then a coding gain of 0 for a particular transform means that no gain is 
achieved by applying the transform to the signal. The expression most widely known is one that assumes 
very fine scalar quantization of the transformed coefficients and that is independent of the quantization 
level under that assumption. The coding gain then becomes a function of the linear transform only, and 
the source correlation model. For example, the coding gain of the 8-point discrete cosine transform is 
8.83 dB, using a first-order Markov source model with correlation p = 0.95. Other correlation models 
can also be used, as well as the actual correlation statistics of the signal to be coded. The coding gain is, 
therefore, the proper measure of coding performance when high-rate quantization is assumed (i.e., at low 
compression ratios). At low bit rates, the approximations that led to its expression are no longer valid, 
and so the coding performance of the given transform is no longer guaranteed. It can be said, however, 
that quite often transforms that have a large coding gain at high bit rates tend to perform well at lower 
bit rates, as can be observed from actual rate-distortion curves [2]. 

In [3], Katto and Yasuda derive an expression for the coding gain that is valid for nonunitary subband 
transforms (such as the biorthogonal wavelet transform). If M is the number of subbands, h k (i) ( k = 
1, . . . , M) are the coefficients of the fcth analysis filter, g k (j) (k = 1, . . . , M) are the coefficients of the kth 
synthesis filter, and p is the correlation of the source modeled as a one- dimensional Markov source, their 
expression for the coding gain is 


Gsbc{p) = 


1 

n ti(AkB k )^ 


where 


Afc = EE hk(i)h k (j)p l3 z| 

i 3 

Bk = 


and a k is the subsampling ratio for the A:th filter (i.e., a k = 1/M for a uniform subband decomposition). 
The coding gain for the two-dimensional case is simply twice the value in the one-dimensional case. 

Note that, for tree-structured subband decompositions, Gsbc is a function of the following: 

(1) The subband decomposition, which can be entirely defined by a binary tree 

(2) The analysis lowpass and highpass filters, Hq[z) and Hi(z), and the synthesis lowpass 
and highpass filters, G 0 (z) and G 1 (z) 

(3) The source correlation model 

We will consider two types of subband decomposition: “logarithmic” decompositions, for which only 
the downsampled output of the analysis lowpass filter may be further decomposed, and “arbitrary” 
decompositions, for which there is no constraint on which downsampled output may be decomposed next. 
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A “uniform” decomposition up to level L would correspond to a binary tree of depth L. The L will 
always be referred to as the maximum depth of the tree. The analysis lowpass and highpass filters, H 0 (z) 
and Hi(z), and the synthesis lowpass and highpass filters, Gq(z ) and G\(z), are required to satisfy the 
PR conditions (Fig. 1). The model used is a two-dimensional separable Markov model. Even though our 
results will be limited to a Markov model, the design methodology used can easily be extended to any 
other source correlation model. 


First, we review the known upper bounds on the subband coding gain. Then we examine the limiting 
case p — ► 1 and show that a necessary condition for the coding gain to be adequate as p — > 1 is for Hi(z) 
to have a zero at dc frequency. Finally, we describe a useful normalization of the coding gain, which 
compares coding gain values to the known upper bounds for orthogonal wavelet filters. 

A. Known Upper Bounds 

Almost all the theoretical results on subband transform coding are about orthogonal subband trans- 
forms. We know that the largest coding gain achievable by any linear transformation for a Markov source 
with correlation p is that obtained by the Karhunen— Loeve transform (KLT) (an orthogonal transform) 
as the block size goes to +oo : 


Gklt(p) = j 

1 — p z 


In [5], de Queiroz and Malvar give an expression for the largest coding gain attainable by any orthogonal 
subband transform for depth-L logarithmic subband decompositions, which corresponds to the coding 
gain of the HR sine filter: 


hk 


sin(7rfc/2) 
7T&/2 ’ 


— oo < k < -f-oo 


(13) 


the frequency response of which is an ideal lowpass filter. They use it to show that orthogonal wavelet 
transforms are asymptotically suboptimal. We will refer to that expression as G LT (p,L), where L is the 
number of levels of decomposition of the transform. 


The same derivation used in [5] can be used to obtain an expression for the largest coding gain 
attainable by any orthogonal subband transform for depth-T uniform subband decompositions; we note 
it as Gut{p,L). Naturally, in the limit as L — > +oo, we have Gut(PiL) — * Gklt{p)- Therefore, the 
subband coding gain of any orthogonal subband transform of maximum depth L is upper bounded by 
Glt{p,L ) for logarithmic decompositions and by G UT {p,L ) for uniform decompositions. 

B. Limiting Case: p— * 1 

For values of p close to 1, only the expression for Ak changes when evaluating the coding gain Gsbc{p)- 
By writing p— 1 — e, and assuming ck, 0, we obtain for Ak 

Ak = EE h k {i)h k (j){ l-e) |j j| 

i 3 


A k * EE hk(i)h k (j)(l - \j — i\e) 

i 3 
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If Yhi hk (i) = o, the A k simplifies to 


A fc « - [ ^2^2h k (i)h k (j)\j - i\ j e 


* j 


Otherwise, it simplifies to 




Therefore, in the limit as £ -> 0, the coding gain is significantly larger by imposing £ h k (i) = 0, i.e., 
iJi(l) = 0, corresponding to a zero at 7T. 


C. Coding Gain Notations 

In the following, only dB values of the normalized coding gain (NCG) will be given. The NCG 
is obtained by computing the dB value of the subband coding gain, and subtracting the dB value of 
Glt(p, L), so that the wide range of coding values can be displayed on the same graph. All NCG values 
will be given for values of p between 1/2 and 1. As mentioned earlier, logarithmic and arbitrary subband 
decompositions will be considered. For logarithmic decompositions, values of the NCG will be given for 
a maximum depth L equal to 8, while for arbitrary decompositions, we chose L = 6. This means that 
the NCG values will slightly vary for logarithmic and arbitrary decompositions, although they remain 
comparable, due to the limited changes in subband coding gain for L = 6 and L = 8. 


In all NCG curves (Fig. 2), the highest solid curve (which we refer to as the reference UT curve) 
corresponds to the upper bound provided by the Gut(p, L), itself normalized by subtracting the dB value 
of Gl T (p,L). The other solid curve (flat and equal to 0) is simply the reference curve for logarithmic 
decompositions (which we refer to as the reference LT curve), i.e., the dB value of G LT (p,L). The gap 
between the two solid curves is simply the coding gain gap mentioned in [5] between the optimal uniform 
and logarithmic subband decompositions for orthogonal filters. 



Fig. 2. Normalized coding gain of optimized n-tap orthogonal filters ( n = 4, 8, 14, 20): (a) 8-level logarithmic 
decomposition orthogonal filter and (b) 6-level uniform decomposition orthogonal filter. 
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V. Optimal PR Filters 

Given the expression for the subband coding gain, and a parametrization of HSS and WSS filters, we 
now look for filters with optimal coding gain performance as a function of average filter length. Then, 
we will look for integer approximations of these filters which yield similar coding gain performance. We 
now briefly review known results on orthogonal filters which maximize the subband coding gain [9]. 

A. Orthogonal Filters 

The parametrization used here is the one described in [6], a parametrization of even n-tap orthogonal 
filters with one zero at 7 r using n/2 — 1 free parameters. The optimization was performed for logarithmic 
and uniform decompositions for five levels of decomposition. 

The NCG curves are provided in Fig. 2 for the usual values of n — 4, 8, 14, and 20, and were computed 
for 8 and 6 levels of decomposition, even though the optimization was done for L = 5. The corresponding 
coding gains for L = 5 and p = 0.95 can be found in Table 3. The filters obtained were very similar for 
both types of decomposition, and similar to those found in [9]. The filters obtained are local maxima of 
the coding gain, and are believed to be very close to the global maxima. An interesting characteristic of 
these filters is that they have a maximum number of roots on the unit circle. 

Table 3. Coding gain performance of 
optimal FIR/FIR filters, logarithmic de- 
compositions, L = 5, p — 0.95, for 
orthogonal filters. 


Filter 

length 

Coding 
gain, dB 

2 

8.24 

4 

9.29 

6 

9.62 

8 

9.74 

14 

9.85 

oo 

9.91 


B. LP Biorthogonal Filters 

Optimization of the subband coding gain is possible given an efficient parametrization of the various 
families of filters. The parametrization of FIR/FIR solutions is more complex due to the many combi- 
nations of filter lengths for a given average filter length. The parametrization of FIR/IIR solutions is 
simpler, since the parametrization of Hq(z) is all that is required. 

1. FIR/FIR Solutions. Given an even average filter length n, the possible filter length combinations 
\h Q \/\hi\ are of the type \h 0 \ = k and |/i x | = n - k, with k = 1, . . . , n/2. This means that the filters can 
be either HSS or WSS, resulting in different parametrizations. 

For WSS filters, Theorem 1 describes how to generate all the filters H[(z ) of length |/i 0 | — 2 + 4m 
complementary to a filter H 0 (z). In [7], it is shown that there exists a unique filter H 1 (z) complementary 
to Hq(z ) with |/ii| = jho| — 2. A useful consequence of that result is that there exists a unique filter H\{z) 
complementary to H 0 (z) with j/iij = \h 0 \ + 2 with the added constraint that Ri(l) = 0. These unique 
solutions can easily be found by solving a system of linear equations corresponding to the PR conditions. 
Parametrizing WSS filters is, therefore, done in two steps: (1) parametrizing a filter H 0 (z) and calculating 
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its unique complementary filter Hi(z ) (with |fii| = |/i 0 | ± 2 depending on whether i?i(l) = 0 is required 
or not) and (2) parametrizing all the filters H[(z) of higher order and complementary to Hq(z). Note 
that if the desired lengths |fio| and |/ii| satisfy |/i-o| < one simply can replace the analysis filters by 
the synthesis filters and note that |pi| = |/i 0 | < |fii| = |tfo|> allowing the suggested parametrization. 

For HSS filters, Theorem 2 describes how to generate all the filters H[(z) of length |/t 0 | + 4 m comple- 
mentary to a filter H 0 (z). The parametrization again takes place in two steps: (1) parametrizing a filter 
H 0 (z) and calculating its unique complementary filter H x (z) (with \hi\ = \h 0 \) and (2) parametrizing 
all the filters H[(z) of higher order and complementary to H 0 (z). For the case of |fi 0 | < the same 
remark made above concerning WSS filters applies here. 

All optimizations were carried out for average filter lengths of n = 4, 6, and 8, with p = 0.95 and 
L = 5 Ievels of logarithmic decomposition. For n = 14, only the 17/11 filter length combination was 
examined, ifi(l) = 0 is imposed on all solutions. The optimal filter coefficients are given in Table 4 and 
the corresponding coding gain values in Table 5. In Table 5, note the higher coding gains obtained by 
LP filters, even higher than the upper bound for orthogonal filters (Table 3)! 


Table 4. Optimal linear-phase FIR/FIR filter banks. 


i 


(^l)±i 

i 

(^o)i, (ho)-i-i 

(hi)i, (hi)-i-i 


5/3 Filter 



2/6 Filter 


0 

1.02707904 

0.70710678 

1 

0.70710678 

0.70710678 

1 

0.38713452 

-0.35355339 

2 


0.09733489 

2 

-0.19356726 


3 


-0.09733489 


5/7 Filter 



6/10 Filter 


0 

0.95902785 

0.75833803 

1 

0.79363797 

0.60082030 

1 

0.36569130 

-0.36322679 

2 

0.08023230 

-0.14072753 

2 

-0.13809844 

-0.02561563 

3 

-0.16676349 

-0.07121045 

3 


0.00967340 

4 


-0.01194390 




5 


0.02482550 

9/7 Filter 

0 

0.81096744 

0.79365640 




1 

0.39424588 

-0.43412065 




2 

-0.11475353 

-0.04327481 




3 

-0.02568087 

0.08056725 




4 

0.04781158 





17/11 Filter 

0 

0.83851308 

0.70235757 




1 

0.45656233 

-0.41589851 




2 

-0.09573748 

-0.02337038 




3 

-0.11802962 

0.09492166 




4 

0.06386749 

0.02574498 




5 

0.01728699 

-0.03257654 




6 

-0.03776016 





7 

-0.00625838 





8 

0.00791907 
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Table 5. Coding gain performance of optimal 
FIR/FIR filters, logarithmic decompositions, 
L — 5, p = 0.95, for LP filters. 


Mean filter 
length 

Coding 

gain 

IM/IM 

2 

8.24 

2/2 

4 

9.60 

5/3 

6 

9.71 

5/7 

8 

9.88 

9/7 

14 

9.96 

17/11 

oo 

? 

? 


2. FIR/IIR Solutions. For FIR/IIR solutions to the PR equations, the parametrization is lim- 
ited to that of the prototype filter H 0 (z). The corresponding inverse HR filters are unique and can be 
approximated by long enough truncations of the HR filters for coding gain calculations. 

All optimizations were carried out for L — 5 levels of logarithmic decompositions and p — 0.95. 
#i(l) = 0 (equivalently H 0 (- 1) = 0) is imposed on all solutions. Filter lengths considered for H 0 (z ) 
(and therefore H^z)) were n = 3, . . . , 11. The optimal coding gains obtained are given in Table 6 as a 
function of filter length, dhe only filter lengths of interest from a coding gain perspective are clearly 
n = 3, 6, and 7; larger coding gains are attainable with FIR/FIR solutions for n > 8. The corresponding 
optimal analysis filter coefficients for n = 3, 6, and 7 are given in Table 7. Their IIR inverses can be 
computed using Eq. (8). 


Table 6. Optimal coding gain as a func- 
tion of filter length for FIR/IIR 
combinations. 


Filter 

length 

Coding gain, 
dB for p = 0.95 

3 

9.36 

4 

9.33 

5 

9.36 

6 

9.70 

7 

9.76 

8 

9.74 

9 

9.79 

10 

9.84 

11 

9.84 


3. Integer Approximations of Optimal LP Filters. Because of the complexity constraints 
imposed by onboard processing, it is often useful to look for integer approximations of good filters. 
Rather than conduct an exhaustive search of all PR solutions with integer coefficients, we narrowed our 
search to a neighborhood of the optimal filters arrived at earlier. We also restricted the coding gain of 
the integer approximation to be within 0.05 dB of the coding gain of the filter it is approximating, a 
constraint that always leads to solutions of minimum integer ranges. 
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Good integer approximations to optimal FIR/FIR filters are given in Table 8. Again, #i(l) = 0 is 
required of all integer solutions. A few others exist and are in the immediate neighborhood of those given. 

Table 7. Optimal analysis FIR filters 
with inverse MR filters. 


Length 3 

i 

(^o)±i 

0 

0.70710678 

1 

0.35355339 

Length 6 

i 

o 

1? 

o 

Y 

1 

0.64546192 

2 

0.13959559 

3 

-0.07795073 

Length 7 

i 

(ho)±i 

0 

0.75048476 

1 

0.42976974 

2 

-0.02168899 

3 

-0.07621635 


Table 8. Integer approximations of optimal analysis FIR/FIR filters; 
the coding gain (CG) is given for p = 0.95 and L — 5. 


\ho\f\ht\ 

ho 

hi 

CG 

2/6 

[1, 1] 

[1, 1, -8, 8, -1, -1] 

9.59 

5/3 

[-1, 2, 6, 2, -1] 

[-1, 2, -1] 

9.59 

6/6 

[-1, -2, 32, 32, -2, -1] 

[3, 6, -32, 32, -6, -3] 

9.68 

5/7 

[-1, 3, 8, 3, -1] 

[1, -3, -31, 66, -31, -3, 1] 

9.70 

9/7 

[2, -1, -6, 19, 44, 19, -6, -1, 2] 

[2, -1, -12, 22, -12, -1, 2] 

9.86 

6/10 

[-2, 1, 10, 10, 1, -2] 

[-2, 1, 6, 12, -57, 57, -12, -6, -1, 2] 

9.87 


Good integer approximations to the analysis FIR filters of FIR/IIR solutions are given in Table 9. 
Again, #i(l) = 0 is required on all integer solutions. The integer range is, not surprisingly, lower than 
that of the integer FIR/FIR solutions, since the complexity (here the integer range) is minimized at 
the encoder, at the cost of more complexity at the decoder. The truncated HR inverses of these three 
filters can be found in Table 10, while their closed-form expressions were derived earlier in Examples 
1-3 (Section III.B). Actual implementation of these inverse filters should involve truncations of the HR 
inverses, so as to minimize the average or maximum reconstruction error, for example. 
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Table 9. Integer approximations of optimal analy- 
sis FIR filters with inverse HR filters; the CG is 
given for p = 0.95 and L = 5. 


Filter Filter Coding 

length coefficients gain 


3 [1, 2, 1] 9.36 

6 [-1, 2, 9, 9, 2, -1] 9.69 

7 [-1, 0, 7, 12, 7, 0, -1] 9.74 


Table 10. HR inverses of FIR filters with integer coefficients: 
coefficients with 8 decimal points only. 



h 0 = [1, 2, 1] 

h 0 = [-1, 2, 9, 9, 2, -1] 

ho = [-1, 0, 7, 12, 7, 0, -1] 

i 

(so)±i 

(So)i, (<7o) — 1 — i 

(go)±i 

0 

1.00000000 

0.74953169 

0.88621564 

1 

0.41421356 

0.08132065 

0.43634598 

2 

-0.17157288 

-0.16264131 

-0.14842319 

3 

-0.07106781 

0.00882291 

-0.11356570 

4 

0.02943725 

0.03529163 

0.07681856 

5 

0.01219331 

0.00095724 

0.04203769 

6 

-0.00505063 

-0.00765795 

-0.02465968 

7 

-0.00209204 

0.00010386 

-0.01521935 

8 

0.00086655 

0.00166170 

0.00908314 

9 

0.00035894 

0.00001127 

0.00537790 

10 

-0.00014868 

-0.00036057 

-0.00322211 

11 

-0.00006158 

0.00000122 

-0.00193014 

12 

0.00002551 

0.00007824 

0.00115210 

13 

0.00001057 

0.00000013 

0.00068826 

14 

-0.00000438 

-0.00001698 

-0.00041153 

16 

-0.00000181 

0.00000001 

-0.00024596 

16 

0.00000075 

0.00000368 

0.00014697 

17 

0.00000031 

0.00000000 

0.00008784 

18 

-0.00000013 

-0.00000080 

-0.00005250 

19 

-0.00000005 

0.00000000 

-0.00003138 

20 

0.00000002 

0.00000017 

0.00001875 

21 

0.00000001 

0.00000000 

0.00001121 

22 


-0.00000004 

-0.00000670 

23 


0.00000000 

-0.00000400 

24 


0.00000001 

0.00000239 

25 



0.00000143 

26 



-0.00000085 

27 



-0.00000051 

28 



0.00000031 

29 



0.00000018 

30 



-0.00000011 

31 



-0.00000007 

32 



0.00000004 

33 



0.00000002 

34 



-0.00000001 

35 



-0.00000001 



VI. Optimal Boundary Filters 

The standard signal extension technique used for LP filters is known as the symmetric extension 
technique. We propose to choose the signal extension that will yield the largest coding gain and to 
compare the coding gain thus attained with that obtained by both the symmetric and circular extension 
techniques. Since there is an equivalence between signal extension and modification of the filters at the 
left and right boundaries of the signal, we will now talk exclusively about boundary filter design. 

We will illustrate our method with the optimization of the boundary filters for the 5 /3 filter: 

H q {z) = [- 1 , 2 , 6 , 2 , - 1 ] 


and 


Hi(z) = [-1, 2, -1] 


Consider a signal of length 8. The following matrix A, 


(a b c 
f -2 4 -2 
-1 2 6 2 -1 


V 


-2 4 
d e 


\ 


1 A 

h i) 


corresponds to the parametrization of the linear transform that is equivalent to the one-level decompo- 
sition of a signal of length 8, with the parameters a, b, c, d , e, /, g , /i, and i. The inverse matrix B 
should be of the type 


(\ 


B = 32 x A~‘ = 


? 

? 

? 

? 


2 

4 

2 


-1 

2 

6 

2 

-1 


V 


-1 

-2 

? ? ? 

? ? ? 

? ? ?/ 


where the question marks indicate unspecified values that depend on the choice of the parameters of matrix 
A. A simple analysis shows that biorthogonality is preserved if the following equations are satisfied: 


a + b + c =8 
b + 2c =0 


2 d+e =0 
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d + e + f + g — 8 


(14) 


h + i — 0 
—h -j- i =8 

which yields the parameters as a function of a , /, and g only. 


c = a — 8 

b = —2c — —2a + 16 
d — f + g — 8 

e = -2d = -2/ -2^ +16 (15) 

h = - 4 
i = 4 


We limited our search to integer values of the three parameters, a, f, and g , and obtained the largest 
coding gain for a five-level decomposition with the following parameter values: a — 6, / = 3, and 5 = 4, 
be., b = 4, c = —2, d = —1, e — 2, h — —4, and i = 4. 


and 


/ 6 4 -2 \ 

-24-2 I 

-1 2 6 2 -1 


-2 4 -2 

-12 3 4 

V -4 4/ 


ft 


5 = 


-4 
5 2 
-2 4 
-1 2 


-1 

2 

6 

2 

-1 


V 


\ 


-1 

-2 

6 2-2 
-2 4 -4 
-2 4 4 / 


198 



In Table 11, we give the coding gain that was computed for five levels of logarithmic decomposition, 
with p = 0.95, for the three types of signal extension and various signal lengths. The difference between 
symmetric and optimal extension becomes insignificant at large signal lengths, but is important for smaller 
ones, and so the use of optimal extensions is relevant, particularly in applications in which an image might 
be divided into smaller separate blocks for compression. 

Table 11. Coding gain performance of finite length 
signals with 5/3 filter. 


Signal 

length 

Circular 

Symmetric 

Optimal 

64 

9.16 

9.28 

9.39 

128 

9.37 

9.44 

9.49 

256 

9.48 

9.51 

9.54 

512 

9.55 

9.55 

9.56 

oo 

9.59 

9.59 

9.59 


VII. Conclusion 

Two families of LP filter banks were examined for efficient implementation as part of an onboard 
image compression system. The first family (FIR/FIR solutions to the PR equations) exhibits the same 
complexity at the encoder and the decoder. The shortest filters of that family with the best coding gain 
performance were designed using a parametrization scheme specific to that family. Integer approximations 
for that family of filters with similar coding gain performance were also designed. The coding gain perfor- 
mance of this family of LP filters is better than that of orthogonal filters for logarithmic decompositions; 
for long enough filters, their coding gain is above the upper bound over all possible orthogonal filters. The 
second family (FIR/IIR solutions) exhibits an asymmetry between the computational complexity at the 
encoder and the decoder, allowing for less complexity at the encoder, at the cost of more complexity at the 
decoder. Filters that maximize the subband coding gain were designed, as well as integer approximations 
with similar coding gain performance. The range of the coefficients of the integer approximations was 
found to be less than that of counterparts from the first family of LP filters with equivalent performance, 
validating the approach consisting of designing filters with asymmetric characteristics at the encoder and 
at the decoder. 

These summarized results point to the following conclusions when comparing orthogonal and biorthog- 
onal wavelet filters: 


(1) For the same average filter length, biorthogonal wavelet filters yield larger coding gains 
than their orthogonal counterparts, when logarithmic decompositions are considered 

(2) Biorthogonal wavelet filters can be used in asymmetric applications, which require very 
low complexity at the encoder (or the decoder), unlike orthogonal filters 

Further investigations that incorporate other design criteria, particularly at low bit rates such as 
minimal ringing around edges (usually obtained with short filters) and a visual evaluation of the distortion 
present in the reconstructed images, are required in wavelet filter design. This study illustrates the 
improved design flexibility of biorthogonal wavelet filters over orthogonal filters, which is likely to be 
confirmed when using objective functions other than the coding gain. 
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